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Abstract 

The article is devoted to the resampling approach application to the reliability problems. This 

fT^ ' approach to reliability problems was first proposed by Ivnitsky (1967). Resampling is inten- 

T— I I sive statistical computer method, which is non-parametrical, that uses initial samples data in 

^^ ' different combinations to simulate the process many times and get finally the estimator of the 

O^ ' characteristics of interest. At the present paper simple resampling, hierarchical resampling, 

^ , the case of one sample for several variables, the case of partially known distributions, anal- 

Oh' ysis of degradation flow, analysis of degradation-renewal process, construction of confidence 

•^ I intervals are described. All those resampling application cases can be applied successfully to 

^^ . solve the reliability problems as an alternative to classical methodsQ 

I— !■ Introduction 

.^ , Computers play an important role in the development of modern statistical science. Many statistical 

• ' methods developed in the last time require a big amount of computations. Such methods are usually 

C^ . called intensive statistical methods. Some authors speak about separate discipline called "computational 

c/2 ; statistics" (jGentle 2002p . 

In statistical problems of reliability we often have difficulties with application of classical methods. 

^~^ . In the case of complex systems, small samples, unknown distributions of system characteristics classical 

JiZ. \ methods work not so good. In this case, methods of computational statistics can be used as an alternative. 

r~^ ' The field of computational statistics at present time includes a big number of methods. Jack- 

^^ , knife method was suggested by M. Quenouille in 1949 ( [Quenouille 1949| . It uses the estima- 

^^ ' tor, which is the combination of the estimator's obtained using all data and the estimators, ob- 

^r . tained using only part of the same data. In 1967 V. Ivnitsky ( [Ivnitsky 1967 ) suggested to use re 

m ■ 



X 



sampling for the estimation of the systems' reliability by simulation. B. Efron (jEfron 1979|) sug- 
gested bootstrap method, which is the generalization of the jackknife method. Resampling ap- 
proach was investigated from 1995 under prof. A. Andronov supervision. During this investigation, 
simple and hierarchical resampling ( [Andronov, Merkuryev, and Loginova 1995] ) and their implementa- 
tions in reliability theory, queuing theory ([Andronov and Fioshin 1999al lAfanasyeva 2002^, stochas- 
Cd i tic processes ([Andronov 20001 [Afanasyeva 2005a| [Andornov, Afanasyeva, and Fioshin 2006) , optimiza- 

tion tasks ( [Andronov and Merkuryev 2000[ ) and construction of confidence intervals ([Andronov 20021 
lAndronov and Fioshin 2004[) were considered. The present paper is devoted to the description of the 
main results connected with the reliability problems. 

The classical " plug-in" approach consists in the choosing of the forms of unknown distributions and 
estimating their unknown parameters on the base of available sample populations. Then the estimated 
distributions are used in formulas for calculation of unknown parameters instead of real values or they 
are used for generation of the pseudo-random numbers, which are used in simulation instead of latter 
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variables. Here the estimation of probability distributions, espetially in the case of small initial samples, 
leads to making mistakes in choosing the form of a distribution and estimating its parameters. It can 
lead to the bias of estimated parameters and results of the simulation. 

Resampling is an alternative approach. We do not estimate unknown distributions, but extract values 
from initial sample populations at random and use them as values of input variables during simulation. 
This method does not require any preliminary information about the type of the distributions, so it is 
non-parametrical. It uses the available information in different combinations, which require a big number 
of computations, but allows to get good estimators in situations, where classical estimators are not good. 

The first section of the present article is devoted to the main principles of the resampling approach. 
The resampling algorithm and the principals of the resampling estimator calculation are described. The 
variance of the estimator is supposed to be criterion of obtained estimator efficiency. In the case of biased 
estimators it is better to take the mean squared error as the criterion of efficiency, which is calculated on 
the base of variance and bias. The variance is calculated on the base of resampling pairs (a;-pair, /3-pair, 
a-pair). The resampling pair shows the common elements structure of two different resamples, so the 
type of the pair depends on the problem. In this section the resampling is applied to the estimation of the 
reliability function of logical schema. Different variants of this method are described: simple resampling, 
hierarchical resampling, resampling of one sample for several distributions and the case of partially known 
distributions. 

In the second part the resampling approach implementation to stochastic processes analysis is de- 
scribed. Two problems are considered there. The first problem is analysis of the degradation process 
with the accumulation of damages. The second problem is the comparison of two renewal processes 
implementing to the analysis of degradation-renewal process analysis. 

The last part of the article is devoted to resampling application to the interval estimation of logical 
system and the algorithm of true coverage probability calculation of the constructed confidence interval. 

Finally the concluding remarks are made. All the parts contain only the brief description of the 
considered problems and the main results. For more detailed description please refer to a bibliography, 
which is presented at the end of the article. 

1 Resampling estimation of reliability function of logical schemes 

1.1 Simple resampling 

Let we have a known function (t>{xi, X2, . . . , Xm) of m real arguments. This function can represent some 
characteristics of m-element logical system with working times of elements xi,X2t ■ ■ ,Xm (for example, 
the total working time of the system, the indicator that the system works at the given time t etc.). 

Let we have a vector of m independent r.v. 'K.= {Xi,X2,. ■ . ,Xm), each component with unknown cdf 
Fi{x); only sample populations H=(iJi,i/2,. . . ,H„i), Hi = {Xi^i,Xi^2, ■ ■ ■ ,Xi,ni) are available for each 
Xi, Ui = \Hi\. Let our parameter of interest is the expectation of the function 0, which argument is 
vector X: 

e = i?0(x). (1) 

We have to estimate 8 on the base of given sample populations H. 

The classical nonparametric plug-in approach is the following. We calculate the empirical cdf Fi{x), 
i=l,2,. . . ,m on the base of samples H, take formulas for calculation of Q (which include Fi{x)) and use 
Fi{x) instead of Fi{x). This gives formula for plug-in estimator O of O. Usually this estimator has good 
properties, but in some cases (the same samples for the same variables, small samples, etc.) it can have 
big variance or be biased. 

The resampling approach is nonparametric approach to systems simulation and estimation 
( [Andronov and Merkuryev 2000p . It is a simple alternative to classical methods. We perform the follow- 
ing iterative procedure. On the g-th step we extract at random one element X*'' from each population 
i?i, i — 1.2..., m. Let j{q) = {ji{q), J2{'l), ■ ■ ■ , jmiQ)} be the indices of extracted elements in the 



corresponding populations H, so X*"^ — Xij.(^qy The estimator 6*' of 9 is calculated using vector 
X*« = {X*"?, X*'', . . . X;„9} as argument of the function (/.: 

e*-? = E <?!)(X*«). (2) 

The procedure is repeated r times, and as the estimator <d* of 9 an average of all 8*"^ is taken: 

1 '' 

e* = -^e*«. (3) 

The obtained estimator ([3]) is unbiased: 

£; 6* = e. (4) 

So, in order to provide proper application of resampling method, we should know other properties of 
8*. In most cases estimators' variance Var 8* can be taken as efficiency criterion. Although, in some 
situations the estimator 8* is biased and then bias and mean squared error MSE 8* also should be 
calculated. 

The variance Var 8* of the resampling estimator 8* is: 

yar8* = - yare*« + ^— ^ Cow(8*«,8*'^') = %2 + ^— ^/ill-M^ 9 7^ ?', (5) 

r r r r 

where ^i2 ^ E ([8*9]2), /in = E Q*iQ*<i' {q ^ g'), ^ ^ E Q* . 

In this formula, the variance Var 8*', the second moment /i2 and the expectation /i depend only 
on the properties of the function (f) and r.v. X. Only the covariance Cow(8*'^, 8*'^ ) and the mixed 
moment /in depend on the applied resampling procedure. So our goal is the calculation of the variance 
© depending on the used resampling procedure. 

In order to calculate the covariance Cow(8*'', 8*'' ) or the mixed moment /in, we introduce the 
notation of the u;-pair. 

Let M — {1,2,..., m}. We say that two vectors j(g) and j((?') produce the w-pair, u) C Af , when 
ji{q) = ji{q'), ii i (z <jJ and ji{q) ^ jiiq'), if i ^ w. So, the u;-pair shows indices of the arguments which 
have the same elements from the initial sample populations in two different realizations q and g'. 

For example, let we have function (/)(a;i, a;2,X3,a;4, xs) and the resample vectors j{q) — (4,1,2,3,3) 
and j{q') = (1, 2, 2, 4, 3). In this case, they will form uj = (3, 5)-pair. 

Let us denote Au; the event "a;-pair is happened". Let P{u)}~P{Au}} be the probability of this 
event. We can calculate the covariance Cov{Q*'^, 8*' ) or the mixed fin given Au;. 

Let C{u:) — Cov{Q*'^, 8*' )|Ati;, q ^ q' he conditional covariance given a;-pair. Let /in (a;) = /tii|Aa;, 
q =/: q' he conditional mixed moment given a;-pair. Then Coi;(8*', 8*'' ) can be calculated as follows: 

Coi;(8*«,8*«')= J2 PW}C{u}). (6) 

LJeM 

The mixed moment fin can be calculated as follows: 

fill = Y^ P{a;}/inM. (7) 

u)eM 

Now let us show how to obtain the probabilities P{i^}- As the arguments of the function <j) are 
independent and the probability to extract the same element from Hi twice on the q-th realization and 
on the q'-th realization is l/rii, the probability P{i^} can be calculated as follows: 



The construction of all a;-pairs is simple combinatorial problem. By constructing all the u;-pairs we 
can calculate the variance ([5]), using formulas (H))-©. 

As an example, let us consider a system "2 of 3" (jFioshin 2003|) . It consists on 3 elements, and it 
works if at least 2 of 3 elements work. The problem is to estimate the probability that at the time moment 
t the system works. 

The function of interest is the following indicator function (f)t{xi,X2,X3): 

, , , f 1 if at least 2 elements of {xi,X2, 2:3} are greater than i, 

(j)t{xi,X2,X3) ^ < ^ ,, 

[^ otherwise. 

Our aim is to estimate the probability that system works at time moment t as the expectation of the 

function: Qt = E 4>t{xi,X2,X3). 

In our case the following 8 w-pairs are possible: {}, {!}, {2}, {3}, {1, 2}, {1, 3}, {2, 3}, {1, 2, 3} 

The probabilities of the w-pairs and the mixed moments /in (a;) can be easily calculated. This allows 

us to use the resampling approach and to calculate the variance of obtained estimator. 

1.2 Hierarchical resampling 

Often the simulated system is complex, but structured. It can be split onto subsystems, which can be 
simulated separately. Then, the results of subsystems simulation can be used to simulate the whole 
system. In this case we can use hierarchical resampling. 

Simple resampling can also be used for analysis of hierarchical systems. We can extract, like in previous 
section, values for input data from initial samples, calculate the value of function of interest without 
paying attention to its hierarchical structure and get the simple resampling estimator. But hierarchical 
resampling has some advantages in the described situation ( [Andronov, Merkuryev, and Loginova 1995] ) 
and allows: parallel calculations, sample sizes optimization, more clear analysis of the efficiency. 

Let the function (p has hierarchical structure, i.e. it can be split into subfunctions (j)i. The results of 
subfunctions are used as arguments of the functions on the higher layer. 

It is convenient to represent function cf) by the calculation tree. The root of this tree has index 
k and corresponds to the function <j) — (pk- Nodes with indices 1,2, ...,to correspond to input vari- 
ables Xi, ^2, . . . , Xm. The rest nodes are intermediate ones, which correspond to intermediate functions 

4>m+l, (f'rn+2, ■ ■ ■ , 0/c-l- 

Let us denote /" the set of nodes, from which arcs go to the node v, and Iq - the set of initial variables, 
such that the node v depends upon them. Note that for vertices of the same level the sets /" do not cross 
and the sets Iq also do not cross. 

Now, the function <j> can be calculated by so-called "wave" algorithm 
( [Andronov, Merkuryev, and Loginova 1995[ ). We create samples Hm+i,Hm+2,---,Hk sequentially. 
The sample H^ = {X^j^i, Xy^2, • ■ • , X^^n^), v = m + l,m + 2, . . . ,k — 1 is calculated by extracting values 
from corresponding samples Hi,i Cz ly and using them as arguments of the function (f)y. It is clear that 

Xy,g = <j>iX*''\ie r),q^ 1,2,..., n,. (9) 

Finally, the estimator Q* of 8 can be calculated as an average of the sample Hk elements at the root 
of the calculation tree: 



nk 



1 . ''. 

e* = — VXfc,,. (10) 
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Now our purpose is to calculate variance Var 9*. It can be calculated by formulas ©-([T]), but using 
slightly generalized oi-pair notation. 

Let us consider the value Xy,q, calculated by formula (jH]). It was calculated using only one value from 
each sample Hi, i ^ Iq. Let us define these values indices in the initial samples by vector j*' (q) = {Jl'iq)}, 



i e Iq. Some elements of vectors j^ (g) and j'"(q') can be equal. So, we can use almost the same definition 
of the w-pair. 

Let M={i,2,. . . ,m}. We will say that two vectors j''(g) and j"{q') produce the w-pair, u! C M, when 
jUi) = JT(9'), if * e '^ and j^q) ^ jKi'), if * ^ '^^ 

Let AIj be the event "the w-pair takes place at the node v" . Let P^{(jj} be the probability of this 
event. The values of P'"{lj} is calculated recurrently. If the node v is on zero level {1 < v < to), then 
P"{a;} can be calculated easily: 

ro ifc.^0, 

^ ' \ 1 otherwise. ^ ^ 

Now let us consider a node v on another level. Let us consider a sample Hi, i £ /" from which the 
node V depends. The probability that some element from Hi is chosen twice: for Xy^q and for Xy^q' is 
equal to l/rii. 

The event A]^ can happen if in each node i G /" one of two events occurs: 

• We selected different elements from Hi for Xy^q and Xy^ (with the probability 1 — l/rii) and 
selected elements produced a; n Jq - pair (with the probability P*{a;}); 

• We selected the same element from Hi for Xy^q and Xy^qi (with the probability l/rii). In this case 
all elements from /g will be extracted twice. The event A^ can happen in this case only if all 
elements of /g belong to w: Iq C u). 

Now let us denote Si^u:- 

[_ otherwise. 
Now we can write formula for the calculation of P"{a;}: 

P'W} = n ((1 - lM)^n^} + (l/nO(5.,a;) • (13) 

Our goal is to calculate P''{u)} for all u) G M. This will allow us to use formula (jH]) or ([7]) for 
calculation the value fin or Cov{<d*'^,Q*'^ ). Then we will use ((S]) for calculation of the estimator 8* 
variance. 

Let us consider an example. Let we have a system that consists of 6 elements. The 1-st and the 2-nd 
elements are connected in parallel, the 3-d and the 4-th elements are connected sequentially, the 5-th and 
the 6-th elements are connected in parallel, but the 6-th element is switched on when the 5-th element 
fails (cold reservation). Our purpose is to estimate the probability that the system will work at the time 
moment t. 

Our function of interest (pt can be denoted as follows: 

, , , f 1, ii min(max{xi,X2),min(x3,X4),X5 + Xe) < t, ,_, 

(j)t[Xi,X2,X3,X4,X5,Xe) = < . (14) 

The function (j>t can be represented by using the calculation tree. The tree has 6 leaves, three elements 
on the first level correspond to the functions max{xi,X2), min(x3,X4) and X5 + xq and the element on 
the second level (root of this tree) corresponds to the function min. 

In this case we have 4 u;-pairs in each node on the first level and 8 w-pairs in the root of the tree. 
This allows us using the resampling approach and calculating the variance of obtained estimator. 



1.3 The case of the only one sample for several r.v. 

In this section we will show how to deal with in the case, when only one sample is available for sev- 
eral logical elements. This situation can often appear when elements are considered to have identical 
characteristics. 

Let we have a function (f>{xi, X2, ■ ■ ■ , Xm)i but some arguments are considered to be statistically iden- 
tical. We have only one sample for all identical arguments. Let the numeration of arguments corresponds 
to the order of sample numbers. So, let we have samples Hi, H2, ■ ■ . , Hk and the sample Hi is used for 
arguments (x/._j-|-i . . -Xi-) (and we put ^0 = 0)- Let rrii be a number of arguments, for which the sample 
Hi is used, rrii = U — Zi_i -t- 1. 

The resampling approach here is the following; on the g-th realization we extract one value for 
each argument from the corresponding population. The values from one sample are extracted without 
replacement. The extracted values are used as arguments of the function (/), and the resampling estimator 
for g-th realization Q*'' is calculated by formula ^. Finally, the resampling estimation Q* is calculated 
by formula ^. Note that obtained estimator is unbiased. Our goal is to show how to calculate its 
variance. 

The variance Var 8* is calculated by formula ([5]). In order to calculate the covariance Coti(8*', 8*"^ ) 
we generalize the notation of a;-pair, introducing the /3-pair. The idea lying behind this definition is the 
following: in the previous cases, where a;-pair was used, the same element from initial sample in two 
different realizations q and q' was possible only for the argument Xi. In the present case the same 
element in two different realizations q and q' is possible for different arguments, namely any of arguments 
{xi._j^+i . . . xi.) can have the same element, because it is extracted from Hi for all of them. The /3-pair 
shows what arguments have the same elements extracted. 

Let j{q) = {ji{q),J2{q), ■ ■ ■ ,jm{q)) be the indices of elements extracted on the q-th step. Note that 
Ozi_i-i-i('?) ■ • -Jhil)) ^-re indices in the sample Hi and they are different, i = 1, . . . , fc. 

Let f3 — (/?i, /32, . . . , /3m)- We say that two vectors j{q) and j{q') produce the /9-pair when for all i if 
Ji{Q) — jvil') and v G [U-i + 1; li], then /3i = v, otherwise Pi = 0. 

For example, if we have a function (j){xi,X2,xz,X4^,x^) and two samples Hi and H2, the first sample 
Hi is for arguments (a;i,a;2) (this means h = 2) and the second sample H2 is for arguments {x^^x/i^x^) 
(this means I2 — 5). Now let we have resample vectors j(g) = (4,1,2,3,1) and j((7') = (1,2,2,4,3). In 
this case, they will produce (3 — (0, 1, 3, 5, 0)-pair. 

Note that the w-pair is the specific case of the /3-pair. /3-pair becomes w-pair when only two variants 
are possible: /3i = z or Pi — 0. Also, zeros in the u;-pair are not stored. 

The variance of obtained estimator can be calculated by formula ^. In order to calculate the 
covariance Coti(8*', O*"^ ) or the mixed moment /in, we can use formula ^ or ([7]), where we use the 
probability -P{/3} of /3-pair, conditional covariance C(/3) given /3-pair and the conditional mixed moment 
/Liii(/3) given /3-pair. 

Now let us show how to calculate the probability -P{/3} of the /3-pair. The arguments can be split 
into independent blocks. The block i corresponds to arguments which belong to the sample Hi. Let ai 
be a number of non-zero elements at the block i. Then the probability P(/3) can be calculated using the 



hypergeometrical distribution 



Ui — nii 
Oii I \mi — Of, 



Note that in the case when rii < 2mi, it is impossible for two samples not to have common elements. For 

this case, let us put I j = 0, if fc > n. 

The calculation of C(/3) depends on the function (j> structure. Note that for the calculation of the 
probability P{f3) we need only the information about a number of non-equal elements in each block. In 



general, the information about the indices of equal elements is used for a calculation of C{(3). 

Now let us consider a specific case of the above described situation - the case when some elements are 
not simply equivalent, but their influence to the system work is equivalent ([Fioshin 20001 iFioshin 2002)) . It 
can happen in the situation, when the function is commutative by the block arguments, i.e. changing 
the order of arguments inside the block does not change the function result. Note that a reliability 
function, which includes identical elements, can often be commutative by these arguments, because can 
include sum, min, max etc. of these arguments. 

Here, we do not need to store for each element of j(q'), what element oij{q') contains the same element 
of corresponding sample. We need only to know how much the same elements were selected for each block 
from the corresponding sample. So, instead of m-element /3-pair we introduce the /c-element a-pair. 

Formally, we say that two vectors j{q) and j{q') produce the ct-pair if for all i \{jii_i+i{q) ■ ■ -Juiq)} H 
{Jh-i+iil') ■ ■ ■Jiii'l')}\ — Q^ii * = 1, . . . , fc. This means that a-pair stores only the number of common 
elements inside each block. The probability P{a) can be calculated by formula P^ . 

For example, if we have a function (j)(xi, X2, x^, x^, x^) and two samples Hi and H2, the first sample 
Hi is for arguments (a;i,a;2) (this means li = 2) and the second sample H2 is for arguments (X3, 0:4, 2:5) 
(this means I2 =5). Now let we have resample vectors j(g) = (4, 1, 2, 3, 1) and j(q') = (1, 2, 2, 4, 3). In 
this case, they will form a = (1, 2)-pair. 

1.4 The case of partially known distributions 

In the previous sections we supposed that distributions of all r.v. X={Xi, X2, . . . , X„i} are unknown, but 
only sample populations H are available for each variable. In many practical situations the distributions 
of some r.v. are known, but the distributions of the rest r.v. are unknown, and only sample populations 
H are available. The problem is, how to use the available information about r.v. distribution in the most 
efficient way ([Andronov and Fioshin 1999bp . 

Let be a known function oi m + v independent r.v. X={Xi, X2, ■ ■ ■ , Xm} with unknown distribu- 
tions, 7i—{Zi, Z2, . . . , Z^} with known distributions; 0(X, Z). The problem consists in estimation of the 
expectation <d — E 0(X, Z). 

The idea of the estimation of <d is the following: we use the conditional expectation of (/'(X, Z) given 
X: 

ff(x) = ii;(</>(x,z)|x). (16) 

It is clear that Q ^ E g{X). 

Two situations are possible for the conditional expectation (1161) : either (7(X) has known functional 
form for any X or the functional form of ^(X) is unknown. 

In the first case we can operate as in usual simple resampling, but we estimate E g(X.) instead of 
E (ppC). In each realization we create a resample X*'^ and use it to estimate E g(X): 9*' = g{X*'^). 
Then, the estimator 6* can be obtained by formula ([3]). 

Now we consider the case when the conditional expectation (J16p is unknown. In this case we are 
able to estimate ^(X), because the distributions of random variables Z are known. On the q-th step we 
generate N mutually independent realizations Z*^'* of vector Z, i = 1, . . . ,N and estimate E g(X) in the 
following way: 

1 ^ 

Q*q ^_J2 (j){X*\ Z*9^*). (17) 

1=1 

Then the estimator 6* can be obtained by formula ([3]). 

Now let us see how hierarchical resampling can be applied in the case of partially known distributions. 
Let the function (/> be calculated by a calculation tree. The leaves of the tree correspond to the variables 
Xi. Note that the intermediate functions i^m+i, 4>m+2, ■ • ■ , 0fe depend on the values of child nodes and 
the variables Zj. 



Instead of the conditional expectation g(X), we must know the conditional distribution function 
Fv.xiy) of each 0i,(X, Z) given X: Fy^x{y) = -P{0i.(X, Z) < y}. As in the case of the simple resampling, 
two variants are possible here: either the distribution function Fy^xiv) can be calculated in each node v 
or it is unknown. 

Let us consider the first variant when during a sequential calculation of our function we are able to 
find conditional distributions of its subfunctions. Let Gj(jj) — P{Zj < y} is known distribution function 
of Zj. Then Fy^xiv) can be calculated in usual way: 

Fy^xiy)^ J J ...JlldG.iz,). (18) 

,p^iX.Z)<y J 

As the result, we have the following procedure. Let us consider the first (not initial) level. We choose 
values from samples Hi, i G I^ . It allows us to calculate a realization F^ ^{■) of conditional distribution 
function F^^xi') by formula (|18p . We repeat this procedure Uy times and get a sample population Hy, 
which elements are the distribution functions F^ ■^{■), q = 1,2, ... ,ny. 

Now let a vertex v be an intermediate one. We have to extract the distribution functions Fi instead 
of simple values. Let {F*'j({-)}, i e /" be the set of the distribution functions, extracted on the g-th step 
from the child samples. Then we calculate the distribution function 



pi 



(y)=//--7n^*'(y')n^G^(^^) (19) 



0„(F,Z)<y 



and use it as q-th element of the sample Hy . 

Finally for the root k of the calculation tree we calculate the estimator 8* by the following formula: 

r °° 

^* = lY.[ydFly(yh (20) 

where r = Uk- 

Now we consider the second variant when the conditional distributions of the available subfunctions 
are unknown. For each vertex v and realization number q = 1, 2, . . . , n„, we have a sequence X'^ c, ^ — 
1,2, . . . , N oi N independent realizations of subfunction (/)w(-) with the same distribution function F^ yi')- 
Therefore, the q-th element of the sample population Hy is the vector Xg = {X'^ , : ^ = 1,2,..., N} that 
"represents" unknown distribution F^yi')- 

On the q-th step we extract a vector from each sample Hi, i e /„, forming resample X*i = {X*'^}, 
i G I^ . Then for each random variable Zi we generate (by the random number generator) a vector of N 
its independent realizations, forming vector of Z realizations: Z*i — {Z*"^}; Z*' = {Z*'i : £, — 1,2, . . . , N} 
in accordance to the distribution function Gi(-). Further we calculate values X^^ = (j)y{X*'^^,Z*%) and 
form a vector X^ — (X^ ^ : £^ — 1,2, . . . , N), which becomes g-th element of the sample Hy. 

When the root k of the calculation tree will be reached, we are able to estimate Q by analogy with 

r N 
9=1 C=l 

where r — n^. 

Note that previously Hy has denoted as the sample of function </>„ values. Now we have more general 
case: Hy denotes either the set of the conditional distributions {^y y(-)} or the set of vectors {X^} which 
represent these distributions. 

Let us consider the same system as in the Section 1.2, but with partially known distributions. Let us 
denote variables from that problem as X'l, . . . , Xg. Let the distributions of random variables X[, X'^ and 



Xg are unknown, but the distributions of X2, X'^ and Xg are known. In our present definitions, Xi = X[, 
X2 — X^, X3 = X'^] Z\ = X2, Z2 = X'^, Z-j, = Xq. Our characteristic of interest 6 is the expectation of 
function 

, , N f 1 iimin{max{xi,zi},min{x2,Z2},X3 + Z3}<t, 

(j)t(Xi,X2,X3,Zi,Z2,Z3) ^ < 

[ otherwise. 
Here we have the case when the conditional expectation ([TE| is known. It can be calculated easily: 



gtixi,X2,xs,) 



1, if a;2 < t, 

1 - 'G[{t)(h(t)Gl{t - xa), if X2 >t,xi< t, X3 < t, 

G2{t)G'i{t- X3), ii X2 > t,xi > t,x3 <t, 

G^{t)G^(t), if X2 >t,xi< t, X3 > t, 

G2(i), \iX2> t,Xi> t,X3> t. 



Now we are able to use the resampling approach to estimate 6*. In this case, we have 8 w-pairs, 
which are subsets of M={1,2,3}. We can calculate the values ^11(0;) and P{oj}. 

2 Resampling estimation of stochastic process parameters 

2.1 The failure model with accumulation of damages 

Above we consider statistical models where time factor is absent. On the contrary stochastic processes 
have a dynamic character. Here the efficiency investigation of resampling estimator encounters great 
difficulties (|Andronov 2000[l . Let's consider some statistical models, which are implemented to different 
reliability problems. 

The model with accumulation of damages was considered in ([Afanasyeva 2002) and 



( [Andornov, Afanasyeva, and Fioshin 2006| . It is based on the failure model and its modifications, 
presented in (lAndronov and Gertsbakh 19721 lAndronov 19941 IGertsbakh 2000p . The model supposes 
two types of failures - initial and terminal failures. The initial failures (damages) appear according to a 
homogeneous Poisson process with rate A. Each initial failure degenerates into a terminal failure after 
a random time Z . So if i-th initial failure appears at time t^ then the corresponding terminal failure 
appears at the time instant r^ + Z^. Terminal failure and the corresponding initial failure are eliminated 
instantly. We assume that {Zi] are i.i.d. r.v's, independent on r^ with cdf F{x). We take interest 
in the number of initial failures Xt which did not degenerate into terminal failures at time t (further 
initial failures) and the number of terminal failures Yt observed up to time t. Let EXt and EYt be the 
corresponding expectations, Pxti'i) = P{Xt = «}, Pviii) = PiYt = *} be the corresponding probability 
distributions, i = 0, 1, . . .. 

It is well known that Xt and Yt are mutually independent r.v's, by that: 

EXt = A / (1 - F{x))dx, EYt = X I F{x)dx, (22) 

Jo Jo 

Px, (^) = i (EXtY expi^EXt), ^ = 0, 1, . . . . (23) 

i\ 

The probability PyAi) is calculated analogously by formula (|23l) where EXt is replaced by EYt- In 
future all formulas will be obtained for EXt , but for EYt all of them can be calculated analogously. 

The rate A and the cdf Fix) are unknown. Two samples are given: the sample Ha—{Ai, A2, . . . , Anj^ ) 
of the intervals between initial failures and the sample Hb={Bi, B2, . . . , Bn^) of degeneration times. We 
need to estimate EXtjEYtjPxtii) and PvAi) using samples Ha and Hb- 

In order to estimate values (P^ and (P^ we use the resampling approach. On the q-th realization 
we extract (without replacement) elements Aij(g), A^^j^g), . . . from the sample Ha obtaining the g-th 
resample A*'^ — (Aj', ^2', . . . , A*"^), where A^!^ = ^ife((?)- Then we calculate the instants of initial 



failures tJ"^ = A*"^, Tj'' = Tj^'^ + Aj', .... Then we extract ua values Bj-^^q^, Bj^^q), . . . from the sample Hb 
(suppose that ua < ns), obtaining the q-th resample i?*' = {Bi'^, B'^'^, . . . , i?*'^}, where B'^'^ = Bj^^^^y 
This allows us to calculate the instants of terminal failures {tj*' + i?^', Tj'' + 62"^, . . . , t*'j^ + S*"^} and 
keep in mind the number of failures of each type up to time t. Further all extracted values are returned 
into the initial samples and the described procedure is reiterated r times. 

Let Co*' be the indicator function of the event: " The j-th initial failure occurred, but did not degenerate 
into a terminal failure up to the time t " : 

^3 ^ ' \ otherwise. ^ ' 

Then the number of initial failures X^'^ at time t for the g-th realization is Xj*' ~ X]?=i Cj'^(i)- 

The resampling-estimator E*Xt of EXt can be obtained from formula ([3]), where 0*'' = X'^'^ . 

Now we need to calculate the resampling-estimators of the probabilities Pxt{i)- Let P^{i) be the 
indicator function of the event {X^'' = i). The resampling-estimators PJ (z) of the probabilities Pxt{i) 
can be determined by formula ([3]) taking 8*' = P'^{i). 

Let us calculate the expectations of the resampling-estimators (note that they are biased). Obviously 
EP^ (i) = EP^{i), EPy [i) — EPy'ii)- These expectations can be calculated taking into account the 
following reasoning: 1) The probability of the event that the number of initial failures occurred during 
time t is equal to j can be found by a Poisson distribution: dt{j) — Z exp{~Xt); 2) It is known, that 
if the number j is fixed then the moments of initial failures are independent and uniformly distributed 
on (0, i); 3) If u e (fi,t) is the time moment of an initial failure appearance then in the time instant t 
with probability 1 — F(t — u) it remains initial; 4) The probability pi that at time t the considered failure 
remains initial is: pi = j J„ (1 — F{t — u))du. 

Therefore, the expectation E{E*Xt) of the resampling-estimator E*Xt is calculated as follows: 

E{E*Xt)^PiY.jdt{j)+pinA Y. ^*(^')- (25) 

We also can find the expectation EP^ of the estimator PJ («): 

riA / -x / \ 00 

ppi^(z) = 5]d,(j)mpui-pir*+ 7^^i(^-^i)'"' E ^*W' * = i:2,.... (26) 

j=i ^ ^ ^ ^ riA + l 

Let us illustrate the idea of the calculation of the variance of E*Xt. It can be obtained from formula 
©, where &*" = X*". 

For that purpose we need to calculate the covariance Cov I X^'' , X^'^ ) for two different realizations q 

and q' . Let us consider the second mixed moment EX^'^Xl'^ . We have: 

UA riA riA riA 

Ext'^x:'^' ^ Ej2crit)j2c' it) ^Y.T.E^rii)cr' (t). (27) 

j'^l 2—1 J — 1 i—1 

Now we need to calculate EC*'^{t)Q'^ [t). We have to take into account that C*'^{t) and C*'' (t) can be 
formed by the same intervals between initial failures and by the same degeneration times. Let aA be the 
number of the same intervals between initial failures on realizations q and q\ Let Zg = i he the random 
event "the j-th initial failure in the q-th realization and the i-th initial failure in the q'-th realization 
have the same degeneration time." Then 



;^o ^ (28) 

{P{R'g ^ ^})E{C,''{t)C{t)\Z% ^z,aA = ^)) ,3<i. 



All elements of formula ((28)) can be easy calculated. It gives us a possibility to calculate the variance 
®. 

As an example, let us consider a Poisson flow of initial failures with rate A=0.5 and the triangular 
distribution of degeneration times with parameter a=2. 

Table [T] presents the expectations EPxt («) of the plug-in estimators Pxt (*) and the expectations 
EP^ of the resampling estimators P^ (i) (formula (jSj) for the time i=5. The last column contains the 
real probabilities values Pxti"^) according to formula (|23l) . The expectations are calculated for different 
numbers of initial failures i and for different sample sizes ua (here ub — tia)- We can see, that with 
increasing of ua the bias decreases, especially the bias of the resampling-estimator. 



Table 1: Expectations EPx^{i) of the Plug-in Estimators and EP^^{i) of the Resampling-estimators 
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HA 


=:4 


UA 


= 6 


riA 


= 8 
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EPxS) 


EP*xM 


EPxM 


EPU^ 


EPxM 


EPxS^ 


PxM 





.348 


.370 


.350 


.368 


.352 


.368 


.368 


1 


.307 


.374 


.325 


.368 


.334 


.368 


.368 


2 


.176 


.189 


.183 


.184 


.186 


.184 


.184 


3 


.087 


.058 


.083 


.062 


.800 


.061 


.061 


4 


.041 


.009 


.035 


.015 


.031 


.015 


.015 


5 


.019 




.014 


.003 


.011 


.003 


.003 


6 


.010 




.006 




.004 




.001 


7 


.005 




.002 




.001 







Table 2: Expectations, Variances and Mean Squared Errors of the Plug-in and Resampling Estimators 
of EX^ 



i 


riA = 3 


n^ = 4 


nA = 5 


nA = 6 


nA = 7 


nA = 8 


E{EX^) 


1.41 


1.32 


1.25 


1.21 


1.19 


1.16 


E{E*X5) 


0.89 


0.96 


0.99 


0.997 


0.99 


0.99 


VarEX5 


1.52 


0.79 


0.51 


0.38 


0.30 


0.24 


Var E*X5 


0.58 


0.55 


0.49 


0.43 


0.36 


0.31 


MSE EX5 


1.69 


0.89 


0.57 


0.42 


0.34 


0.27 


MSE E*X5 


0.59 


0.55 


0.49 


0.43 


0.36 


0.31 



Table [2] presents expectations E{EX^), i?(i5*X5), variances VarEX^ ,VarE*X5 and mean squared 
errors MSE EX5, MSE E*Xz for the estimators EX^, E*X^. Note that the real values are EX^ = 1. 
We can conclude that in many cases the resampling approach gives better estimators, if the criteria of 
efficiency are bias, variance or mean squared error. 

We can conclude, that the proposed resampling-approach is a good alternative to the traditional 
plug-in approach. Here the rate of convergence to the real values for the resampling-estimators is much 
more, than for the plug-in estimators. The only disadvantage of the resampling-approach consists in the 
impossibility to get good estimators of the probabilities EP'^ (i) for i > ua- In this case it is better to 
use the plug-in estimators. Here it should to combine both approaches, using the resampling-estimators 
for i < HA, the plug- in ones for i > ha and the normalization of the given probabilities. 

2.2 The process of degradation - maintenance 

Those problems were considered by Afanasyeva(Fioshina) in ( [Afanasyeva 2005a| ) and ( [Afanasyeva 20055] ) . 
Suppose we have two simple independent renewal processes Xj, i=l,2,... and Yi, i=l,2,..., where Xi and Yi 
are the sequences of nonnegative independent r.v., each with its common distribution function (|Cox 19621 



IRoss 19921) . Let £),„ = /.^' ^^'^ ^m = /.^i be the times of the m-th renewal for corresponding 

1=1 1=1 

processes. The cdf Fx{x) and Fy{x) of sequences Xi and Yi are unknown, but corresponding initial 

samples Hx — {Xi , X2 , ■ ■ ■ , Xnx } and Hy = { Yi , I2 , • • • , Yny } of sizes nx and ny are available. Our 
purpose is the estimation of the probability P{Dm > Sk}, where nx < 2m and ny < 2k . 

This problem has a lot of applications, for example, in reliability theory ([Lawless 2002p . Let us con- 
sider the following degradation process. The degradation level is increasing according to the degradation 
and decreasing according to the maintenance. If the degradation level becomes greater than the critical 
threshold K, where isT is a known integer, then the failure occurs. Our purpose is to estimate the failure 
absence probability for the rn-th degradation moment. 

The described example can be considered in terms of renewal processes in the following way. Let the 
degradation corresponds to the first renewal process Xi, ?=1,2,... and the time of the m-th renewal be 
the time of the m-th degradation. Let the maintenance corresponds to the second renewal process Yi, 
1=1,2,... and the time of the m-th renewal be the time of the m.-th maintenance. Then the probability 
of interest, of the failure absence, is the probability, that the m-th degradation occurs later, that the 
m — K-th maintenance Dm > Sm-K- It is also assumed, that the threshold level K is known. 

Our task is to estimate the failure absence probability P{Dm > Sm-K} that the m-th renewal of the 
degradation process Xi comes later, than the m — K-th renewal of the maintenance process Yi. 

In this case the function of interest is the indicator function 0(x,y) , where x= (xi,X2, . . . , Xmx ) and 
y=(j/i, 1/2, • ■ • , UniY) are vectors of real numbers: 



mx ^nY 



otherwise. 

The resampling approach supposes the following steps. We choose randomly mx elements from the 
sample Hx and my elements from the sample Hy. The elements are taken without replacement, we 
remind that nx > 2mx, ny > 2my. Then we calculate the corresponding value of function (/)(x, y) using 
formula (j29l) . After that we return chosen elements into the corresponding samples. 

We repeat this procedure during r realizations. Let, like it was described in the first section 
jiil) = {Ji (q) f Ji (q) > ■ ■ ■ T Jr^ il)} be the indices of elements from the sample Hi, i & {X,Y} , that 
are chosen at the q-th realization. Then for the g-th realization we obtain the following vectors: 

X*"^ = (Xjl^ (,) , Xj2^ (g) , • ■ • , Xj^x (g) ) , Y*"? = ( Y,a (^) , y,.2, (q-),..., F-i- (,) ) . 

The resampling estimator O* can be obtained by formula ([3]) taking into account that the q-th resample 
estimator O*^ = 0(X*'', Y*''). Obviously the estimator Q* is unbiased according to formula ^. We are 
interested in the variance of this estimator, witch can also be obtained by the formula ([5]), taking into 
account that O = E 0(X, Y). 

In order to estimate the variance of resampling-estimator, we have firstly to find the expression of the 
mixed moment /xn = E Q*iQ*'] from the formula ([S]). 

To calculate the moment fin the notation of a-pairs can be used, which is the specific case of /3-pairs, 
both of them were described in section 3.3. Here we suppose, that each resamples X*'' and Y** form their 
own blocks of sizes mx and my consequently. So, we have \{jj{q), . . . ,i.™'('z)}n{j7(9')' • ■ • 'JI"'(9')}I = Q^i 
for all i G {X,Y}. It means, that for two different realizations q and q' resamples X*'? and X*'' have 
ay common elements and resamples Y*'' and Y*' have ax common elements. The cc-pair consists on 
two elements a = {ax, ay) and i{q) = {j'^('z), j^(9)}- So to find fiu by formula ([7]) we have to calculate 
P{(y.) by formula P^ and /in (a). Now our task is to derive the formula for ij,ii{(y.) for this specific case. 

Let us include in sums Dmx and Smy the upper index, that corresponds to the realization number: 
D"^^ and 5*^^ . Then let's divide each sum into two parts, which consists of the common and the different 
elements of these sums for realizations q and q' (remind that they have ax and ay common elements 



correspondingly) : 



L)9 

mx 

SI -. 



^mx-oix 

-^difiqq) 



D\ 



com{qq') 






~ '-'niY-aY ~'~ "i' 
(99') _ r)Com{qq') _ 

— -L^Qx 



ax 
■com{qq' ) 



D\ 



Qdif(q'q) _ Qdif(q'q) 






d: 



qcor 
OocY 
difiq'q) 



(??') 



r)g' _ T^dif(q'q) 
^mx ^nix-OLx 
qq' _ qdifiq'q) , c^ 
'-'mx ~ '-'my-ar ' '-'ax 



co7n[' 



(m') 

ax 7 

com{qq ) 



c; 



difiqq) _ ndiflqq') 



D 



difiqq') 



(30) 



Therefore we can write: 



/.11(a) = P{<^(X*9, Y*«) = 1,</)(X*«', Y*«') = l|a} = 

— P/r''=°™('J9') \ n'^ifim') r^com(qq') ^difiq'q)^ _ 



+ 00 



p{C*/(99') < z,a*^(9'9) < z}di^,„„(z|a) 

r'+oo 

Fdj/(z|a)2dFco„(z|Q;), 



(31) 



where Fco,„(z|a) is the cdf of C'a°"^'^'^'\ Frfi/(z|a) is the cdf of cf-'^^'''^ and cf-'^^'''^^ They can be 



calculated by the following formula: 



Fco,„(z|a) 



+ 00 



F^^''\x^z)dF^^\x), 



Fdif{z\a) 



-j-OO 



p^nY-aY)^^ + z)dFir""-"-)(x) 



(32) 



where Fj^ (x) is the cdf of r.v. Dm and Fy (z) is a cdf of r.v. Sm- 

Let's illustrate an example. Let r.v. {Xi} and {Yi} have a normal distribution: Xi S 7V(/ix, crjf ), Ki G 
N{iiY, cry)- Then the sum Dmx~ax fro™ formula (|5(I1) has also normal distribution with the expectation 
EDmx-ax ~ ("'•^ ~ ctx)tJ'X and the variance T^ar£)^^_^^ = (mx — ax)cr|-. Analogously, the sum 
SmY-al ^^^ ^^^'^ normal distribution with expectation (my — aY)lJ-Y and the variance {niY — ay)CTy. 
Then cdf Fcom{z\^) and Fdif{z\a) also have a normal distribution. 

Let's Xi G A^(2, 1), Fi G N{2, 1). Let our sample sizes be equal n = nx = ny, and we consider the 
m-th degradation and different threshold levels i^ = . . . 3. All calculations have performed for r = 1000 
realizations. 

Wc intend to compare the variance of estimators of resampling-approach with the mean squared error 
of classical approach. It is so because of resampling- approach estimators are unbiased, but classical ones 
on the contrary have bias. 



Table 3: Experimental results for Classical and Resampling Q* estimators 





K = 


K = 1 


K = 2 


K = 3 


71 = 10,m = 5 


VarS 


.061 


.043 


.015 


.002 


Bias 6 





.028 


.029 


.013 


MSEQ 


.061 


.044 


.015 


.002 


VarS* 


.08 


.055 


.014 


.001 


n — 12,m^ 6 


VarQ 


.06 


.045 


.019 


.004 


Bias 





.028 


.033 


.019 


MSEQ 


.06 


.046 


.02 


.004 


Var e* 


.085 


.058 


.02 


.002 



In Table [3] we can see the resampling-estimators' variance Var Q* comparing with classical approach 
estimators' variance Var Q, bias Bias Q, and mean squared error MSE 0. The table shows how changes 
the results depending on different sample sizes n, degradation number m and the threshold level K. 



3 Resampling Interval Estimation of Logical Systems 

In the previous sections we considered the point resampling estimators. But in many apphcations we need 
to construct a confidence interval for the system characteristics, not only a point estimator. A confidence 
interval allows us better understand the obtained result and its accuracy. 

Last years the bootstrap approach has been applied for confidence interval construction 
( Davison and Hinkley 19971 ), (|DiCiccio and Efron 1996p . In this section the resampling approach is used 



for this aim ( [Andronov and Merkuryev 2000 lAndronov 20011 lAndronov and Fioshin 2004p . As an ex- 



ample, a confidence interval calculation for characteristics of logical system is considered. 

Let a function (j){X), does not depend on exact values of arguments, but on ordering of these values 
only. This function can include boolean operators, comparisons, calculation of order statistics, including 
min and max, etc. It can have two possible results only: one and zero. 

Our aim is to construct an upper confidence interval (a; cxd) for the expectation = E 4>{X), that 
corresponds to the confidence probability 7: 

P{a < e < 1} = 7. (33) 

Note that we are able to consider our function 4>{X) as function of permutations p G 11, where 11 is set 
of all permutations of elements 1, 2, . . . , tti. In order to illustrate function dependence on permutation p, 
we will write (f>{p). We denote IIi a subset of permutations where 0(p) = 1, Ho a subset of permutations 
where 4>{p) — 0: Hi = {p G 11 : 4>{p) = 1}, Hq = {p G II : 0(p) = 0}. Therefore our parameter of 
interest can be written as 6 = P{p G Hi}. 

The procedure of the interval (j33p construction is following. We estimate Q using the resampling 
approach, obtaining estimates Q* by formula ([3]). We repeat the resampling procedure k times, obtaining 
the sequence of estimates 6^, 63, . ■ . , O^. Then we order this sequence, obtaining the order statistics 
^fi)' ®?2)' • ■ • ' ®(fe) ^^'^ corresponding a-quantile ©n^iti) of their distribution, where [afcj = max{^ = 
1, 2, . . . : ^ < ak}. We set a = 1 — 7 and the border of interval ([55]) becomes a = ©ncfci), so (Oli^i^i), 1) 
is accepted as 7-confidence upper interval for the true value of Q. 

Due to the dependence between estimates 8^;, O2, ■ . • , ©^ the true coverage probability of the con- 
structed interval will differ from 7. Our aim is to calculate the true value of covering probability R: 

^ = n©(L«feJ)<0}- (34) 

How can we describe the total sample HiU H2U . . .U Hm after its ordering? Let X/^i-j < X(^2) < • ■ • < 
X(„) be ordered sequence of elements of Hi U H2 U . . . U H„i . It is possible to use n-dimensional vector 
W = {Wi, W2, . . . , Wn), where Wj € {1,2,..., m} and Wj = i means that element X(j) belongs to Hi. 

For example, let to = 3, Xi = {2.5,6.3,1}, X2 = {0.5,2.1,5.3,5.2,0.9}, X3 = {6.1,2.3}. So, then 
n = 10, and ordered sequence is {0.5, 0.9, 1, 2.1, 2.3, 2.5, 5.2, 5.3, 6.1, 6.3}, W = {2, 2, 1, 2, 3, 1, 2, 2, 3, 1}. 

Another way to describe this ordering is protocol notion introduced by Andronov in (j Andronov 2002|) . 
The definition below generalizes the protocol notion for our case. 

Let {x{ ,X2 ,---,Xni), {x\ ,X2 1 ■ ■ ■ ,Xn2),- ■ ■ , {x^ , X2 i ■ ■ ■ , xh^) are real- valued vectors and 

, (1) (1) (1) N / (2) (2) (2) X ^ (m) (m) (m) x ,. 

xi = (a;|^^,a;|2)'---'^(«i))'^2 = [x^^^'yX^^^:^, . . . ,x'^^^^^),. . . ,Xm = (a:|^^%x^2) ' ■ ■ • '^(n,„)) ^'^ecorrespondmg 
ordered sequences: xY"! < xY"! < ... < xY^.., i — l,2,...,m. We call (712 -f l)-dimensional vector 
C(l) — (co(l), ci(l), . . . , Cn^iyl)), co(l) -|- ci(l) + . . . + 0,12(1) = ni a subprotocol of the first level, where 



Cj(l) = #{xv e xi : a;|^j < xV' < 2^(^+1)}, j = 0, 1, . . . , ^2, a;|pj = -00, x^^J^_^_^^ = 00, and #M means 
power of a set M . A subprotocol of the l-th level C(/), / = 2, 3, . . . , to. — 1, is determined analogously using 
union xi U X2 U . . . U x/ of sets xi, X2, . . . , x/ instead of xi, and x;+i instead of X2. We call a sequence of 
subprotocols a protocol C = (C(l), C(2), ..., C(to — 1)). 

For the previous example we have C(l) = (0, 0, 1, 1, 0, 1), C(2) = (4, 3, 1), C = (C(l), C(2)). Obvi- 
ously protocol C and vector W have one-to-one mapping. Often we prefer the protocols, because they 
can be recursively calculated. 



Now the unconditional coverage probability can be calculated as follows: R = J2c PcRc- 

The probability Pc to get a fixed protocol C can be constructed recurrently, using recursion by the 

elements of the protocol C. If the protocol C is fixed, then the conditional probability qc of the event 

{4i{X) — 1} given the protocol C is given by formula 



9c 



Epgn,^p(C) 



ni7i2 



(35) 



where hp(C) is a number of resaniples that correspond to the permutation p. 
The conditional probability of the event Q* < 9 can be calculated by formula 



er-i 

PC = Pc{e* < e} = ^ 



9c(l-9c) 



r-i 



(36) 



Now we can calculate conditional probability to cover the true value of 6: 

k 



i=laki 



)pi(l-Pc)'-«. 



(37) 



Let us consider an example. Let we have rn-element sequential system. Our parameter of interest is 
the probability that the concrete element (for example, with index m) will fail first: 



e = P{X„, = rmn{Xi,X2, . . .,X,n)}. 



(38) 



We need to construct the upper confidence interval for Q with a given confidence level 7. 

Let us use the resampling approach for this task. In this case the function 4>{X) can be represented 



as 



(a:i,X2,. 



, Xr, 



1, ii Xm ^ min{xi,X2,- ■ -^Xm), 
0, otherwise. 



(39) 



Let m — 3; let variables Xi, X2 and X^ have exponential distribution with parameters Ai = 3, A2 = 3 
and A3 = 2. In this case true value of = 0.25. Let also the number of experiments fc = 10 and the 
number of trials in each experiment r = 16. The results are presented in the table H) 

Table 4: Actual coverage probability R depending on sample sizes 



Sample sizes 
(ni,ri2,n3) 


Re 
7=0.5 


quested 
7=0.6 


coverage 
7=0.7 


probabil 
7=0.8 


ty, 
7=0.9 


(3,3,3) 


0.533 


0.576 


0.625 


0.686 


0.770 


(9,9,3) 


0.519 


0.571 


0.630 


0.701 


0.793 


(4,4,4) 


0.521 


0.578 


0.640 


0.709 


0.797 


(6,6,4) 


0.516 


0.576 


0.642 


0.715 


0.807 


(5,5,5) 


0.515 


0.579 


0.646 


0.722 


0.817 


(3,3,8) 


0.516 


0.581 


0.651 


0.728 


0.823 


(4,4,7) 


0.512 


0.580 


0.652 


0.732 


0.830 



Conclusion 

We considered various applications of resampling approach to reliability problems. This approach has a 
number of advantages as it allows to get unbiased estimators for characteristics of interest. It seems to 
us that resampling approach has a perspective future in the statistics and reliability. 
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